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Target problems for approximation routines: 

• Distributed Database Networks 

• Multi-computer Task Allocation and Configuration 

• Electrostatics 

■ The mincut Problem 

• Fitting Spectroscopy Data 

• Conduction of Random Graphs 

We are interested in sharing algorithms, problems, and results.... email address at bottom. 
Introduction 

Since 1985 the group has been using and studying algorithms for the design of complex systems The 
initial project dealt with the design of large distributed database networks, defined by a model developed 
by Ward Morgan of Drexel University (now at Clemson) and his group. 

Optimization consists of allocating database to nodes, specifying the existence and speeds of links 
between nodes, and routing queries and updates - given the query and update traffic from each node to 
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each database. The model accounts for all installation and operational costs and traffic delays and is 
togMy non-linear. Full optimization of a linearized version with an integer linear programming package 
is not teasible for systems of more than a half-dozen or so nodes. We thus began a search for 
randomized algorithms which would provide useful approximate solutions in a reasonable time. 

£™j5j£SlS2SS5 , ft 4 e . m .°nsfrated that simulated annealing could solve exactly small network 
£™™^J^l$&te) e *actly> .a matter of seconds D^afemire^ Xa^HproBIems (10 -20 ntfdeffand 
above) smTrequired minutes or hours, however, so we hegan to look at parallel implementations of 
annealing and hybrid approaches using annealing and branch & bound. 

In the past few years we have concentrated on developing more efficient parallel annealing algorithms 
and have looked at several additional problems, including task allocation and configuration on multi ' 
computers, electrostatic problems, the mincut problem, and the construction of minimum-diameter 
randk>m_graphs. 

Our major accomplishment in the past few years has been the development of a fully adaptive parallel 
annealing algorithm by Allisen Lee. The algorithm requires essentially no input from the user, other than 
routines to generate, evaluate, and modify the model; start and stop temperatures, cooling, and the run 
length are automatically determined. This package, which is written under the CHIMP message-passing 
interface is designed for distributed-memory systems. The CHIMP version will soon be ported to MPI 
and should run on any system supporting that interface. The algorithm is described in Allisen's 
dissertation (download). 

One of the side-effects of this project has been a deeper understanding of the sequential annealing 
algorithm itself - particularly with respect to the effect of machine precision upon the algorithm's 
performance. We have found, for example, that the machine precision places a lower bound on the 
useful temperatures; if the temperature drops below this bound, continued annealing may actually lead 
to an increase in the expected cost. These results are described in a recent paper in Physics Letters A. 

Other Annealing Sites 

• UCLAComputer Science Department 

• Chaco Communications 

• Simulated Annealing Mailing List 

• Richard Frost; Ensemble Based Simulated Annealing 

• Peking University; Molecular Design 

• University of Ghent, Belgium; Positron Emission Tomography 

• Add your page here! Mafl dyke.stiles@ece.usu.edu 



Branch and Bound 

Rick Pennington, starting with a sequential branch and bound algorithm developed by Ward Morgan's 
group for the network design problem, implemented a parallel version in Pascal on a system of 
transputers. Ken Bosworth, now at Idaho State's math department, proposed a hybrid approach using 
branch and bound at the top and annealing at the bottom. 
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Thesis: 

Speedup of a branch and bound network optimization algorithm, R. J. 
Pennington, March, 1988 

Papers: 

iw^nrth K W G S Stiles and Rick Pennington, A parallel nonlinear integer 
ZZ^E SSt b-ed on branch and bound -d ^ted^ealmg, 
ProPlSonference on Parallel Processing for Scentific COhiputmE; 
SIAM, Los Angeles, December, 1987. 

o r l K Bosworth, G. S. Stiles, P. Wheeler, and A. Raghuram 

of distributed database computer networks, Proc. IEEE Region 5 ^onierenoc, 
Colorado Springs, March, 1988 

Stiles GSKW. Bosworth, T. W. Morgan, F. H. Lee and R. J. f«^ on ' 
Pallid option of distributed ^base ^o r^ Proc. First Inf 1 Conf. 
AppUcations of Transputers, Amsterdam, IOS Press, 1989. 



Task Allocation on Multicomputer* 

Nandim UoW and ^ b t?S^S^^— -S S-St'pSS? 

o^prSceUors may be specified or left for the anneals to establ-sh. 

Theses: 

Stochastic Optimization of Task Allocation & Scheduling in a Multiprocessor 

System, N. Udiavar, 1991 

Abstract 

Optimal Allocation of Tasks with Virtual Shared Memory, Jamshed Khan, 

1992 
Abstract 

Papers/presentations: 

Udiavar, N., and G. S. Stiles, A simple and flexible model for the allocation of 
tasks to a sy stem of transputers, Transputer Research and AppUcations 1, 
Amsterdam, IOS Press, 1989. 
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Parallel Annealing 

The parallel annealing work has been carried out by Allisen Lee and Bhavesh Shah. 
Theses: 

Parallel stochastic optimization of distributed database networks, F. H. Lee, 

Sept., 1988, 

Abstract 

Parallel annealing under TROLLIUS, Bhavesh Shah, 1992. 

Abstract 

postcript 

Dissertation: 

Parallel simulated annealing on a message-passing multi- computer, F. H. 

Allisen Lee, June, 1995. * 

Abstract 

Download 

Hardcopy available by request to dyke.stiles@ece.usu.edu 

Slides from the Moscow paper on this project can be found in the Gallery. 

Papers and Presentations: 

Stiles, G. S., K. W. Bosworth, T. W. Morgan, F. H. Lee, and R. J, Pennington, 
Parallel optimization of distributed database networks, Proc. First Int'l Conf. 
Applications of Transputers, Amsterdam, IOS Press, 1989. 

Lee, F. H., and G. S. Stiles, Parallel simulated annealing: several approaches, 
Transputer Research and Ap^fcafiorts 2; Amsterdam/IOS Press, 1989. 

Stiles, G. S., K. W. Bosworth, T. W. Morgan, F. H. Lee, and R. J. Pennington, 
Parallel optimization of distributed database networks, Proc. Intfl. Conf. 
Applications of Transputers, Liverpool, Aug., 1989. 

Lee, F. R, G. S. Stiles, and Viswanathan Swaminathan, Simulated annealing 
on massively parallel machines, World Transputer Conference '94, Lake Cbmo, 
Italy, Sept. 4-7, 1994. 

Lee, F. H., G. S. Stiles, and Viswanathan Swaminathan, Parallel annealing on 
distributed memory systems, Second Intfl. Conf. Software for Multiprocessors 
and Supercomputers: Theory, Practice, Experience, Moscow, Sept. 1 9-22, 
1994. 

Step-wise or Systolic Parallel Annealing 

We have experimented with some step-wise or systolic parallel annealing algorithms. Some of our 
results may be found in the Gallery and in Lee's dissertation. We expect a'paper soon. 



http://www.engineering.usu.edu/ece/research/rtpc/projects/comb/ 9/22/2005 

PAGE 20/34 * RCVDAT 9/23/2005 12:04:13 PM [Eastern Daylight Time] • SVR:USPTO-EFXRF-6/26" DWS: 273830 0" CSID: 9 149521 9 73* DURATION (mm-ss): 14-32 



Sep 23 05 12:10p ANNE V . DOUGHERTY 

USU RTPC Combinatorial Optimization 



9149G21973 



p. 27 

Page 5 of 6 



Miscellaneous Aspects of Annealing 

We have developed some interesting results on the effect of the precision of the random floating-point 
numbers used in the acceptance check on the performance of annealing. The results show that there are 
cases where extending the run-length can lead to increased expected costs. A lower bound on the useful 
temperature is also presented. 

Paper: 

Stiles, G. S., The effect of numerical precision upon simulated annealing, Phys. 

Lett. A, 185, 3, 13 Feb. 1994. 

Compressed Postscript 

Some figures can be found in the Gallery . 

The network model used in much of our research is described in the following paper - as well as in 
Julien-Laferriere f s and Lee's theses and dissertation. 

Paper: 

Raghuram, A., T. W. Morgan, K. Bosworth, G. S. Stiles and P. Wheeler, A 
multi-criteria model for determining the optimal topology and database 
allocation for computer networks, Proc. Montech f 87, Montreal, November, 
1987 



Generic Annealing Packages 

We presently have a generic single-processor annealing package that is available. The basic annealing 
shell is provided; and the user needs only to supply a set of routines to generate a random solution, 
perturb and unperturb a solution randomly, calculate the cost of a solution, and print specific results. The 
package has been used in our research over the past 10 years, and provides (if desired) a great deal of 
information on the performance of the algorithm. 

We also have a generic parallel annealing package that we have been using for the past few years. The 
implementation is simple multiple independent runs - which we have found to very easy and often as 
good as any other parallel approach (see Lee's work above); it definitely applies to any problem! This 
package is written with the MPI standard message-passing interface, so is portable to a wide variety of 
multiprocessors and workstation clusters. (Public domain versions of MPI are available; check the MPI 
pages. 

If you are interested in obtaining one of these packages, please contact Dyke Stiles at 
dyke.stiles@ece.usu.edu. 



Electrostatics 
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This, our only continuous problem, finds the distribution of charged particles which are confined to 
move on the surface of a sphere. The algortihm is from ter Laak et al. [28]. 



The mincut Problem 



The mincut problem involves finding the partition of a graph into two subgraphs, each with the 
number of nodes, such that the number of edges between the partitions is minimized. 



same 



Fitting Spectroscopy Data to a Model 

to^SS'^dSf 118 ° n 3 1,3131161 eeneti ° alg ° rithm ■ ^^^g "y b »d t<> fit laser spectroscopy data 



Construction of Random Graphs 

This project investigates the construction of random topologies for multi-computer networks. Given a 
number of nodes of fixed degree, annealing is used to find the graph of minimum diameter. The program 
is based on a generic parallel annealing package developed with the MPI message-passing interface If 
you have an interest in this package, let us know. 

[USU Real-time, Embedded and Concurrent Computing] [Electrical and Computer Engineering] [USU] 
Send comments to: 

Dyke Stiles at dyke.stiles@ece.usu.edu 
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